AppL No. 10/664,122 

Amdt., Dated September 23, 2006 

Reply to Office Action of March 23, 2006 

Amendments to the Claims: 

This listing of claims will replace all prior versions, and listings, of claims in the 
application: 

Listing of Claims : 

1. (Currently amended) A method for determining a face direction of a person's 
face captured in a digital image , the method comprising the steps of : 

processing said digital image to determine a nose axis of said face in said digital 
image; 

processing said digital image to computed digital data representing a rotation of 
saida face in said using a sing le digital image based on said determined 
nose axis of said face? whor o in a nose axis of said faco in t h o singlo dig i tal 
imag o ic uc o d to compute the r o tat i on 
processing said digital image to computemg digital data representing a tilt of said 
face using the sing le in said digital image; and 

determining a quantitative face direction of said face in said image us i ng based 
on said fee data representing the computed rotation of said face in said image and said 
data representing the comput e d t ilt of said face in said image . 

2.. (Currently amended) The method according to claim 1, furth o r inclu di ng w herein 
the processing said digital image to determine the nose axis of said face in said digital 
image comprises determining said nose axis by maximizing a correlation measure 
between a left side and a right side of said face from left and right sub-images of said 
image, 
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3 {Currently amended) The method according to claim 2, wherein the processing 
said digital image to determine the nose axis of said face in said digital image 
d etermining sa i d nos o a x i s further comprises comparing one of said left and right sides 
with a synthetic side derived from the other of said left and right sides using symmetry 
and a perspective transformation of said other side to compute said correlation 
measure. 

4, (Currently amended) The method according to claim 3, wherein the processing 
said digital image to determine d o t o rm i n i ng s aid no s e axis further comprises applying a 
contrast enhancement algorithm to a nose region of said image, wherein said nose in 
the part of a face that reflects the most light, said reflected light being represented as a 
line-like region close to a real nose axis. 

5. (Currently amended) An apparatus for determining a face direction of a person's 
face captured in a digital image , the apparatus c omprising: 

means for processing said digital image to determine a nose axis of said face in 
said digital image; 

means for processing said digital image to compute digital data representing a 
rotation of said face in said digital image based on said determined nose 
axis of said face comput i ng a rotation of a fac o i n a o inglo digital image 
us i ng a nos e ax i c of said face ; 
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means for processing said digital image to compute digital data representing a tilt 
of said face in said digital image computing a t i lt of said face in said image ; and 

means for determining a guantitative face direction of said face in said image 
based on said data representing the rotation of said face in said image 
and said data representing the tilt of said face in said image u oing th e 
comput o d rotation and comput o d tilt of sa i d fac e. 

6 (Currently amended) The apparatus according to claim 5, wherein said means 
for processing said digital image to determine the nose axis of said face in said dig ital 
image f urth e r inc l ud i ng m o ans for determinesmg said nose axis by maximizing a 
correlation measure between a left side and a right side of said face from left and right 
sub-images of said image. 

7 (Currently amended) The apparatus according to claim 6, wherein said means 
for process in g said digital image to determine the nose axis of said face in said digital 
image f or d o torm i ning said no co axis furth e r includ o s m o ans for comparesmg one of 
said left and right sides with a synthetic side derived from the other of said left and right 
sides using symmetry and a perspective transformation of said other side to compute 
said correlation measure 

8. (Currently amended) The apparatus of claim 7, wherein said means for 
processing said digital image to determine the nose axis of said face in said digital 
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image f or determining said nos e ax is- applies a contrast enhancement algorithm to a 
nose region of said image, wherein said nose in the part of a face that reflects the most 
light, said reflected light being represented as a line-like region close to a real nose axis, 

9 {Currently amended) A computer program produc t for determining a face 
direction of a person's face captured in a digital image , the computer program product 
comprising: 

computer readable program code means for processing said digital image to 
determine a nose axis of said face in said digital image; 

computer readable program code means for processing said digital image to 
compute digital data representing a rotation of said face in said digital 
image based on said determined nose axis of said face computing a 
rotat io n of o fac e in a cinglo d i gital image ucing a nos o a x i c of said fac e; 

computer readable program code means for processing said digital image to 
compute digital data representing a tilt of said face in said digital 



computer readable program code means for determining said quantitative face 
direction of said face in said image based on said data representing the 
rotation of said face in said image and said data representing the tilt of 
said face in said image u G ing th o comput e d rotatio n and comput o d t i lt o f 
said face. 
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10. (Currently amended) The computer program product according to claim 9, 
wherein said computer readable program code means for processing said digital image 
to determine a nose axis of said face in said digital image f urth o r including computer 
r o adab le program cod o m e ans for determin i ng s a i d no se ax i s by maximizesmg a 
correlation measure between a left side and a right side of said face from left and right 
sub-images of said image. 

11 (Currently amended) The computer program product according to claim 10, 
wherein said computer readable program code means for processing said digital image 
to determine a nose axis of said face in said digital image comput o r roadabl o program 
code rn e an o for d e t e rmin i n g s aid nose axis further inc l ud o c comput e r r o odabl o program 
codo moans for comparestng one of said left and right sides with a synthetic side 
derived from the other of said left and right sides using symmetry and a perspective 
transformation of said other side to compute said correlation measure. 

12.-46. (Cancelled) 

47. (Currently amended) The method of claim 46-lJurther comprising generating 
&e-a_plurality of quantitative face directions, wherein said generating the plurality of 
quantitative face directions comprises: 

obtaining a plurality of digital images of the -said f ace; and 

for each of the -said plurality of digital images: 
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processing said each digital image to determine a nose axis of said face in 
said digital image 

processing said each digital image to compute digital data representing a 
rotation of said face in said digital image based on said determined 
nose axis of said face in said each image computing a rotation of 
th o faco from th e resp o ct i v e singl o dig i tal imag e using a noso axis 
of c aid fac e i n th o respect i v o d i g i ta l image ; 

processing said each digital image to compute digital data representing a 
tilt of said face in said each digital image computin g a t il t of tho fac e 
in the r e sp o ctiv o s ing l o digital image ; and 

determining a guantitative face direction of the face in th o rosp e ctiv e said 
each digital image based on said data representing the rotation of 
said face in said each image and said data representing the tilt of 
said face in said each image; 
whereby a plurality of guantitative face directions is obtained us i ng tho computed 
rotat i on an d c omput o d tilt of the faco for the r os pect i v e d i gital i mage . 

48. (Previously presented) The method of claim 1 further comprising providing a 
visual mouse to detect said quantitative face direction as an interface for a computer 
application. 
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49. (Previously presented) The method of claim 1 further comprising providing said 
quantitative face direction as input to a computer application to provide eye-to-eye 
contact communication in video-conferencing. 

50. (Cancelled) 

51 (Currently amended) The apparatus of claim 50-SJurther comprising means for 
gonorating tho p l urality of quantitative fac o d iroo tiono, said m e ans for gen e rating the 
plurality of quantitative fac e d i rect i ons comprising: 

means for obtaining a plurality of digital images of saidt heface; and 
wherein, for each of said plurality of digital images, 

said means for processing said each digital image to determine a nose 
axis of said face in said each digital image determines the nose 
direction of said face in said each digital image; 
said means for processing said each digital image to compute digital data 
representing a rotation of said face in said each digital image based 
on said determined nose axis of said face computes said digital 
data representing a rotation of said face in said each digital image 
based on said determined nose axis of said face in said each 
image c omputing, for e ach of th o plurality of d i gital imag e s, a 
rotation of th o faco from th o r os pect i ve s i nglo d i gita l i mag o u si ng a 
nos e axis-of-caid face in the r e sp e ct i v e -d i g i ta l image ; 
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said means for processing said each digital image to compute digital data 
representing a tilt of said face in said each digital image computes 
said digital data representing said tilt of said face in said each 
digital imagec omputing, for each - of the p l urality of d i gita l i mag os , a 
tilt of th o fac o in t he respectiv e s i ng le digital image ; and 
said means for determining , for o ach of tho p l urality of digita l images, a 
quantitative face direction of saidfo e face in th o rosp e ctive said each 
digital image based on said data representing the rotation of said 
face in said each image and said data representing the tilt of said 
face in said each image determines said guantitative face direction 
of said face in said each digital image based on said data 
representing the rotation of said face in said each image and said 
data representing the tilt of said face in said each image; 
whereby a plurality of guantitative face directions is obtained using the computed 
rotat i on and computed tilt of th e faco for tho r oG p oc tiv o d i gita l imag e. 

52. (Previously presented) The apparatus of claim 5 further comprising means for 
providing a visual mouse to detect the quantitative face direction as an interface for a 
computer application. 
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53. (Previously presented) The apparatus of claim 5 further comprising means for 
providing said face direction as input to a computer application to provide eye-to-eye 
contact communication in video-conferencing. 

54. {Cancelled) 

55 (Currently amended) The method -computer product means o f claim §4-9_Jurther 
comprising computor r e adabl e p rogram code moans for gen e rating tho p l ural i ty of 
quantit a t i vo faco dir e ctions, said computor readabl e program code m o ans for 
g e n e rating th o plural i ty of quant i tativ e fac e dire c ti o ns compri si ng: 

computer readable program code means for obtaining a plurality of digital images 

of saidt he face; 
wherein, for each of said plurality of digital images, 

said computer readable program code means for processing said each 
digital image to determine a nose axis of said face in said each 
digital image determines the nose direction of said face in said 
each digital image, 

said computer readable program code means for processing said each 
digital image to compute digital data representing a rotation of said 
face in said each digital image based on said determined nose axis 
of said face computes said digital data representing a rotation of 
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said face in said each digital image based on said determined nose 
axis of said face in said each image; 
said computer readable program code means for processing said each 
digital image to compute digital data representing a tilt of said face 
in said each diqitai image computes said digital data representing 
said tilt of said face in said each digital image computor r o adable 
program c ode means for com p ut i ng, for e ach of th e p lu ral i ty of 
digit al imag e s, a rotat i on of tho face from th e r e spect i ve s i ng le 
d i gital image u si ng a noc o ax is o f said face i n th e respectiv o digital 
imag e - ' 

computer readab le program cod e m e an s for co mput i ng, for o aoh of th e 



dig i ta l i m a g e; and 

said computer readable program code means for determining , for each of 
t ho plurali ty of dig i tal images , a quantitative face direction of the 
face in tho r o sp e ct i v e said each digital image based on said data 
representing the rotation of said face in said each image and said 
data representing the tilt of said face in said each image determines 
said guantitative face direction of said face in said each diqitai 
image based on said data representing the rotation of said face in 
said each image and said data representing the tilt of said face in 
said each image; 
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whereby a plurality of quantitative face directions is obtained u6inq tho computed 
rotation and comput e d tilt of t he face for the r e spect i ve d igital image. 

56. (Previously presented) The computer program product of claim 9 further 
comprising computer readable program code means for providing a visual mouse to 
detect the quantitative face direction as an interface for a computer application, 

57. (Previously presented) The computer program product of claim 9 further 
comprising computer readable program code means for providing said face direction as 
input to a computer application to provide eye-to-eye contact communication in video- 
conferencing. 

58 (New) The method of claim 47, further comprising: 

determining changes in face direction using said plurality of 

quantitative face directions; 
applying labels to said changes; and 

parsing a sequence of said labels to determine a facial gesture. 

59, (New) The apparatus of claim 51 , further comprising: 

means for determining changes in face direction using said plurality 

of quantitative face directions; 
means for applying labels to said changes; and 
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means for parsing a sequence of said labels to determine a facial 
gesture. 

60. (New) The computer program product of claim 55, further comprising: 

computer readable program code means for determining face 
direction changes using said plurality of quantitative face 
directions, 

computer readable program code means for applying labels to said 
changes; and 

computer readable program code means for parsing a sequence of said 
labels to determine a facial gesture. 
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